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THE PRIMARY MENTAL ABILITIES OF CHINESE STUDENTS: 
A COMPARATIVE STUDY OF THE STABILITY 
OF A FACTOR STRUCTURE 


STEVEN G. VANDENBERG 
University of Michigan, Ann Arbor, Mich. 


INTRODUCTION 


In the search for basic variables in human intelligence, psychologists 
have developed several special methods of multivariate analysis com- 
monly grouped under the term factor analysis. These methods aim at the 
description of a large number of variables in a given field of study (called 
domain) in terms of a much smaller set of variables — linear combinations 
of the original variables— chosen in such a way that as little as possible 
of the information available in the original data will be lost. 

Differences exist in the computational procedures and in the interpreta- 
tion of the factors obtained, but in general the differences do not affect 
the basic principles of the methods. A systematic treatment of the various 
methods and their differences has been made! and a brief summary by 
Jane Loevinger is available. ” 

There has been considerable debate on the meaning of factors found in 
factor analytic studies. Some authors doubt that such factors have any 
psychological meaning. Anastasi® believes that, because it is ‘‘simply a 
mathematical statement of observed relationships among a group of con- 
crete behavior manifestations,’’ a factor cannot ‘‘be interpreted in terms 
of underlying entities.’’ Similarly, Tryon speaks of ‘‘operational unities”’ 
to avoid reifying factors.*’> Thomson takes the position that a factor is 
a more or less accidental conglomeration not due to an underlying unitary 
psychological function, but produced by the more or less accidental 
associations (‘‘bonds’’) existing between the very many segments of 
experience each individual carries with him. °°? At the same time, he 
quotes with approval the idea of Bronson Price '° and of M. S. Bartlett 1? 
that intercorrelations among human abilities may be due, at least in part, 
to cross homogamy. Victoria Hazlitt'? believed that ‘‘the apparent exist- 
ence of a special capacity is to be accounted for by the possession of 
adequate previous experience in that sphere, together with strong conative 
tendencies in relation to it.” 14 

The view that factors may represent real psychological Mnetions is 
supported by most psychologists who are actively engaged in factor 
analysis. The appearance of very similar factors in a variety of studies 
involving different tests and different types of subjects is regarded as 
strong evidence for this point of view. 
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Perhaps the most explicit statement of what a factor is and how it may 
be formed is given by R. B. Cattell’s schema of the interrelations be- 
tween observed trends of consistent behavior (‘‘surface traits’’) and the 
underlying ‘‘source traits.’? 14 

Even if one grants the existence of some real psychological functions 
behind the factors found in a variety of studies, further questions arise 
about the nature of these psychological entities. Are they only the resi- 
due of uniformities in the educational experiences undergone by the 
subjects tested, or do they reflect general principles in the neurophysio- 
logical organization of the subjects, or both? 

At present our knowledge is too limited to answer such questions, but 
an attack on these problems can be made by properly designed studies. 
The present study was planned to make progress toward this goal. 

The reappearance of the same factors in different studies, commonly 
called factor invariance or factor stability, was mentioned earlier as a 
condition for claiming psychological meaning for factors. Repeated 
demonstration of the same factor in different populations is particularly 
necessary because, as Sutherland! warns, factors can be divided and 
subdivided ad infinitum if single studies with highly selected tests are 
made. 

If factors found in one factor analysis of a number of mental tests are 
founded on some psychological entities, whether biologically or culturally 
determined, one would expect to find not only the same factor structure 
upon repeated administration of the same tests or of a set of similar tests 
to the same people, but also the same factor structure from two different 
groups of people who took the same battery of tests, 

Repetition of the same tests to the same people is possible only after 
a considerable lapse of time because, otherwise, the tests would not 
present the same psychological problems on the second occasion; recol- 
lection of the answers given on the first occasion, practice effects, and 
changes in motivation would be among the complications. The identifica- 
tion of similar factors in two different sets of tests administered to the 
Same group of individuals depends on the possibility of calculating indi- 
vidual ‘‘scores’’ on a factor. Until convenient and exact ways are found 
to do so, it is necessary to determine whether inverted FA (Q-technique) 
would group the individuals in the same way. The comparison of factors 
found in two studies where the same tests were given to two different 
groups of individuals is the method followed in the study reported here. 


PREVIOUS WORK 


On the Invariance of Factors when Several Studies 
Are Being Compared 


Thurstone has suggested '®"*® that rotation of axes to simple structure 
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will yield results invariant for the common factors from study to study, 
even under rather wide changes in conditions. That not even rotation may 
be necessary if the conditions are sufficiently similar is suggested by 
the results of a study by Wrigley and Dickman. !° Taking 2 random sam- 
ples of 500 airmen each, these investigators compared the unrotated 
principal axes solution of the 20 tests of the Airman Classification 
Battery for each sample and obtained indices of factorial similarity of 
more than .9 for 2 factors in each sample and of more than .8 for another 
3 factors in both samples. 

Thurstone also stated several conditions for a valid comparison of 
results from different factor analyses. Summarizing these, we may say 
that Thurstone considered a comparison of studies feasible if: 

(1) The groups of subjects studied are so similar that we may expect 
_ that each test will constitute the same psychological task for the two 
groups. 

(2) Partial special selection has not occurred between groups on two 
or more variables (if it has, a new ‘‘incidental’’ common factor would be 
added, but the simple structure would remain the same for the other 
common factors). 

(3) Complete special selection has not occurred on one or more vari- 
ables. Detailed treatment of the effect of selection on the factor patterns 
is given by Thomson and Lederman, ?° Thomson, 7! and Ahmavaaro. 2? 

There is some experimental evidence on the invariance of a factor 
structure. After Thurstone’s 1935 study (published in 1938*°) of the 
primary mental abilities shown in the test performance of college stu- 
dents, he administered batteries of similar tests to various groups of high 
school students and repeatedly found a similar set of factors. Exact com- 
parison of the 2 factor structures is not possible because the tests are 
not the same, but the similarity between the 2 sets of factors found is 
quite marked. 7% 

No formal criteria of similarity were used in the work of several inves- 
tigators who tried to determine whether intelligence follows a process of 
differentiation, that is, whether the various independent factors gradually 
emerge as children grow older. If this were so, factor analyses of test 
scores of several age groups of children would show an increase in the 
number of factors necessary to account for the covariance among the 
tests. 

Asch 24 and H.E. Garrett ?5"?7 found this to be the case, while Pease’s 
failure to find a further increase in complexity when retesting college 
students after 2- and 4-year intervals may indicate that further differen- 
tiation does not occur at that age.?8 Pease used the Graduate Record 
Examination in her study. While this test would allow disparities in 
various areas of school achievement to show, it may not have been a 
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good instrument to investigate changes in the interrelations among more 
permanent mental abilities, 

Chen and Chow’s finding?? of a decrease in the number of factors with 
increasing age rests on questionable grounds, After intercorrelating the 
results of the same 9 intelligence tests for 130 primary school students, 
140 high school students, and 372 college freshmen, they factor-analyzed 
the data for each group separately. They extracted 4 factors for the pri- 
mary school group, 2 factors for the high school group, and 3 for the 
college freshman group. The sum of the 9 communalities for each group 
was, in that order, 4.29, 5.21, and 3.89. Their decision to stop factoring 
was made in an arbitrary fashion: ‘‘As soon as the correlations were 
reduced to the limits within the probable errors of the average correla- 
tions in each group, no more factor was extracted. Sometimes even the 
correlation residues were larger than the average P.E. [my emphasis — 
Author], but since further factor extractings would have loadings all of 
negligible significance, we stopped extracting also.’’ In addition, the 
results for the primary school and high school pupils had been corrected 
for age differences by the partial correlation technique. It seems possible 
that this correlation would leave the variance among the tests greater in 
the primary school group than in the high school group. The entire ques- 
tion of correction for age differences before factor analysis is, in fact, an 
unsettled issue. These interesting data may deserve a careful reanalysis. 

Thurstone attributes the increase in complexity with increase in age 
both to individual differences in the rate of maturing*° and to the fact 
that the same problem may be attacked with a different primary ability at 
different age levels: ‘‘While number problems may be a routine task for an 
adult, they may be inductive tasks for a child.’’ 

Zachert and Friedman®! listed the results of 4 studies side by side in 
4. columns, but did not attempt to calculate an index for the degree of 
Similarity. 

According to an abstract, Reuchlin and Valin*? performed 4 factor 
analyses of the same 15 tests (3 spatial, 4 numerical, 4 verbal, and 4 
reasoning) separately for each of the following groups: urban boys, urban 
girls, rural boys, and rural girls, where the groups were drawn at random 
from 6 randomly selected high schools in France. The total of cases for 
all 4 groups was 1908. It is not clear from the abstract whether the 
similarity of factors was evaluated quantitatively. 37° 

R. B. Cattell has been engaged for a number of years in a series of 
studies of the primary factors in personality. In a recent report,?> he 
Summarizes the agreement between studies for a number of the factors 
found in his work. Cattell is quite interested in expressing the degree of 
agreement quantitatively, as will be shown later, Kamman** compared the 
factor pattern obtained from tests in Spanish and English. He gave 
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American college students who had studied Spanish for 4 semesters 8 
intelligence tests in Spanish and 8 very similar tests in the English 
language. Since he was particularly interested in the effects of the dura- 
tion of training on the factor pattern, he also included 6 tests in an arti- 
ficial language new to the subjects. His study was further complicated by 
his decision to use an auditory presentation for part and a paper-and- 
pencil test for the remainder. He compared the proportion of the total 
variance accounted for by the first principal component of (1) the English 
tests, (2) the tests in the artificial language, and (3) the tests in Spanish 
after he had factored the intercorrelations of all the tests by Holzinger’s 
principal component analysis.' He found, as predicted, that the first 
principal component loadings for the 8 English tests accounted for 6 per 
cent of the total variance while, in the case of the 8 Spanish tests, the 
first principal component accounted for 10 per cent of the total variance. 
The first principal component, however, did account for only 5 per cent of 
the variance of the tests in the artificial language. Kamman made no at- 
tempt to rotate the principal component factors, even though most of the 
last components were made up of essentially zero loadings, so that he 
had a set of common factors considerably smaller than the number of tests. 

Wrigley and Dickman’s comparison of 2 random samples of airmen has 
been mentioned. 19 That similar factors keep reappearing is further docu- 
mented in Wolfle’s survey of factor analysis to 1940.%° This fact has 
recently led to the selection of a number of ‘marker’ variables to identify 
the fairly well-established factors. *° 

The only study, beside Wrigley and Dickman’s, in which quantitative 
indices of similarity are reported appears to be an Army Personnel Re- 
search Section (PRS) report by Tucker.?” To demonstrate a technique for 
rotating 2 factor structures into maximal congruence, he used the results 
of 2 studies; one a factor analysis of Army and Navy classification tests 
given to a group of naval recruits; the other a factor analysis of Army, 
Navy, and Air Force tests given to some airmen and soldiers when there 
were 10 tests common to the 2 studies.**» °° Very high values were 
obtained for the similarity of several factors common to the 2 studies. 
The values for the proposed index ¢,, were as follows: .999883 on Factor 
A, verbal relations; .999984 on Factor B, perpetual speed; .939811 on 
‘Factor C, a numerical aptitude; .999875 on Factor D, tentatively identi- 
fied as a reasoning factor; .999670 on Factor E, technical information; 
and .459917 on Factor F, perhaps a spatial visualization factor weakly 
represented by test items about electric circuits and automotive 
mechanics, .. ©. 


On Quantitative Methods of Comparing Factors 


The simultaneous comparison of 2 sets of numbers or values ratherthan 
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the comparison of 2 single numbers or values has been considered by 
psychologists in 2 different contexts: (1) the comparison of test score 
profiles, and (2) the comparison of factor analytic studies. 

(1) When a number of scores are available for a single individual, a 
presentation of these scores in some standard way has frequently led to 
the practice of regarding this graphic summary as a “‘psychogram,’’ with 
a certain Gestalt over and above the information contained in the compo- 
nent single scores. Such convictions have led to a lively interest in the 
evaluation of the similarity between patterns. A review of approaches to 
comparisons of test pattems is given by Cronbach and Gleser. *° 

(2) A second source of interest in simultaneous comparison of a num- 
ber of values stems from the desire to evaluate quantitatively the agree- 
ment between factors found in separate factor analyses, 

In spite of these somewhat divergent origins, the indices proposed by 
either approach are formally concerned with the same problem; the com- 
parison of two vectors rather than of two single values, and the work on 
either problem throws light on the other approach. This study will be 
concerned only with the second type of problem. 

While quantitative comparison of factors between two studies has been 
mentioned in the past as a means of studying the stability of factors,*? 
the methods proposed usually have been more suitable for score-profile 
comparisons, with product-moment or rank-order correlations usually 
suggested. In recent years there has been a renewed interest in the com- 
parison of factors between studies, and several new methods of evaluat- 
ing the agreement have been proposed. R. B. Cattell and Baggaley*? give 
the following summary of techniques available, listed according to the 
assumptions being made about the type of scale or level of measurement. 


Scale Technique 
Ratio Coefficient of congruence, 
parallel proportional profiles 
Interval Product-moment correlation 
Ordinal p, 7 
Nominal Salient-variable similarity index 


The last-named technique is that proposed by Cattell and Baggaley in 
their report. This index states the probability that, in two studies with n 
common tests in which there are ¢ ‘‘salient’’ (that is, of highest absolute 
value) factor loadings for a factor, there will be c loadings common to the 
two sets that have the same sign. As Cattell and Baggaley point out, 
there is no provision in this formula for oblique factors, and attempts to 
consider obliqueness lead to a ‘‘situation... more complicated than can 
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be represented in terms of elementary probability theorems.’’ Furthermore, 
there is no definite criterion on how high a factor loading must be to be 
considered salient. 

In a 1951 contract research report,*” Tucker reviewed the solutions 
proposed and presented an elaboration of Burt’s ‘‘symmetry criterion.”’ 
Burt stated, in the 1939 article mentioned above,‘*! that ‘‘if A and B are 
any two matrices, then the product AB will not in general be equal to the 
product BA. But if the factors entering into A and B are identical, then 
the products will also be identical; and if A and B, being correlation 
matrices, are each symmetrical, then it must further follow that the 
products AB = BA will also be symmetrical.’? The degree to which such 
a product of the two correlation matrices exhibits symmetry was proposed 
by Burt as a criterion for the similarity between the factors. 

Tucker?’ proposes 2 related indices: (1) a measure of the agreement 
and (2) a measure of the distance between the factor loadings of J com- 
mon tests of a factor from study A and a factor from study B that are to 
be compared. 37 

The measure of agreement is 


=f 


J JraA f ep 


o, = 
2 2 
> freA py fen 


where r indicates that the factors have been rotated into maximal 
congruence, 


The measure of distance is 


2 
> (fyea ia; 7B) 
go Se 
> (fyra + fyep) 


and 
1-9, 


a 1+, 

Tucker’s main purpose in the report is to present a method for rotating 
the 2 factor structures to be compared into a position that will maximize 
the ®,’s for factors common to the two studies. This position is called 
“maximal congruence,’? and the method will be discussed below. The 
same index was proposed by Wrigley and Neuhaus, ** working independ- 
ently of Tucker. 
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Ahmavaaro proposed the use of the transformation matrix GAXEXASY 
to evaluate the agreement between factor matrix X and factor matrix Y, 
where it will usually be necessary to normalize L, and where X and Y 
are orthogonal. *4 


AIMS OF THIS STUDY 


As noted above, one could study the invariance of a factor structure by 
varying the occasions, the tests, or the people. The latter procedure was 
chosen for this study because unusually complete details were available 
about a previous study. In 1938 Thurstone published not only the inter- 
correlation matrix and the derived factor structure for results obtained in 
1935 from testing 234 college students, but also the complete set of tests 
used in the study.*5’*® It was necessary, therefore, only to find a suit- 
able group, give the same tests, and compare the results with Thurstone’s. 

The greater the difference between the two groups, the more impressive 
would be the agreement between factors representing basic abilities, if 
such agreement were found. In fact, it seemed possible that with increas- 
ing differences in the cultural and educational backgrounds of the two 
groups, the factors more subject to cultural and educational influences 
would be increasingly dissimilar between the two studies. Therefore, the 
aims of the present study are twofold: (1) to see if individuals from two 
widely differing cultural and linguistic backgrounds exhibit, in their per- 
formance on mental tests, similar independent abilities as shown in 
agreement between the factor structures (the degree of similarity to be 
evaluated quantitatively); and (2) after assessing the degree of similarity 
of factors between the two groups, to relate similarities and differences 
in the various factors in the two studies to known differences in the edu- 
cational background of the two groups, and to attempt to relate the factors 
and their degree of similarity to such variables as length of stay in the 
United States and other variables indicative of the amount of accultura- 
tion undergone, 

Regarding the second aim, it should be pointed out that a comparison 
of only two groups does not lend itself very well to a systematic evalua- 
tion of the effects of cultural differences on the similarity of factors; 
consequently, this study can only suggest relationships. For an attack on 
noncultural, genetic influence on factors the method of comparing identi- 
cal and fratemal twins, for instance, would be more suitable, 

As noted above, the greater the differences between the two groups, the 
more striking would be the agreement, if found. The most crucial test for 
the universality of pattems of independent abilities would consist of a 
study of the intercorrelations of scores on a number of tests administered 
to American Indians or members of some African tribe, provided that the 
individuals had not been exposed to education along Westem lines. Since 
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the number of intelligence tests that could be administered successfully 
to such individuals (in their native language) is exceedingly small, this 
approach is virtually closed to the psychological investigator. A few tests 
designed to test the intelligence of individuals from entirely different 
cultures have been devised, 47»48 

The next best thing seemed to be to find a group differing from Ameri- 
cans to a lesser extent than the Indians and Africans mentioned above, 
but brought up in a language as different as possible from English. It is a 
difficult task to find a sufficiently large and homogeneous group of sub- 
jects who have obtained most of their educational experiences under a 
system differing sufficiently from that of the United States to make a 
comparison of factor structures interesting, and who, at the same time, 
would be able to take psychological tests and follow test instructions in 
_ English. Of the many groups of students from foreign countries attending 
universities in this country, the Chinese constitute one of the largest. 
Their language is very different from English; Karlgren*® gives a descrip- 
tion of its main features. In addition to the possibility that a difference 
in language structure may lead to differences in thought processes, there 
is reason to believe that solving problems presented in any foreign lan- 
guage may constitute per se a complication that induces differences. 
Finally, there is the possibility that the greater insistence in China on 
absolute standards of attainment in all school subjects and the great 
uniformity of curricula and teaching methods lead to differences. Few 
courses in high school are electives, and most schools have one fixed 
program of courses that all students in a certain grade must follow. 

The not uncommon practice in the United States of passing students in 
elementary and high school, regardless of grades, may tend to lower inter- 
correlations between achievement measures. While innate differences in 
the various abilities within one individual would probably exist under any 
system, such differences may be kept at a minimum when graduating 
pupils have been required to reach more or less uniform standards of 
achievement in all school subjects. 

The following additional points are also concerned with the aims of the 
study: 

(1) No comparison is intended of the level of intelligence of Chinese 
and United States citizens. Such a comparison would be meaningless 
without very elaborate matching and sampling procedures in the selection 
of subjects to be included in both groups. 

(2) The relative importance of innate versus cultural influences in 
determining the relationship between the various mental abilities can only 
be hinted at in this design. 

_ (3) Inextricably commingled in this study are the influences of both an 
educational system and language of a type entirely different from ours, 
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and the fact that tests were being taken in a foreign language (English), 
necessitating frequent translation into the native language. 

(4) The influence of age upon mental organization will not be touched 
on, although these subjects were somewhat older than Thurstone’s (see 
below). Reichard®® reviews this topic. 

(5) The analysis of tests with a time limit may give entirely different 
results from an analysis of tests without these limits. This complication 
was avoided by the use of timed tests only. 

(6) For reasons similar to those just mentioned, right and wrong an- 
swers were not considered separately. For the tests taken from Thurstone, 
his scoring formulas were used, which include (for tests 18, 20, 40, and 
50) a correction for guessing consisting of subtraction of the number 
wrong from the number right. Fruchter®! discusses the possible differ- 
ences in factor patterns between right and wrong scores. 


METHODS 
Selection of the Tests 


The common tests. Twenty tests were selected from among the 57* 
used by Thurstone and published by him as a supplement. *® Their selec- 
tion was guided by the following considerations. In general, the two tests 
with the highest loadings for the various factors identified were included. 
Where there was a choice, the tests with the highest communalities were 
selected. Finally, an attempt was made to select the shorter tests to keep 
the testing time and cost of printing low. A list of these tests is given in 
TABLE l., 

Tests of English. To obtain further information about the degree of 
familiarity with the English language 4 subtests, comprising the University 
of Michigan English Language Institute test of English, were selected. >? 
This test, constructed by Robert Lado of the English Language Institute, 
Ann Arbor, Mich., for the express purpose of assessing the foreign stu- 
dent’s knowledge of English, has a split-half reliability of .95 after use 
of the Spearman-Brown formula. 53 


Examples of the types of questions in the four parts of the test follow: 


L1 Structure 
My roommate and I sat down. 
‘Sat’? probably refers to an action 
(1) complete and past 
(2) incomplete and past 
(3) in progress and present 


*The 57 tests were numbered 4 to 60 in Thurstone’s monogr 
aph, and this syste f 
labeling has been retained in this paper, j pete 


eS 
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TABLE 1 
DISTRIBUTION OF TEST SCORES 


T hurstone’s Chinese 
data data 


Reading 

Verbal classification 
Completion 

Cubes 

Flags 

Form board 

Punched holes 
Identical forms 
Number code 

Addition 
Multiplication 
Arithmetical reasoning 
Reasoning 

Verbal analysis 

Code words 
Word-number memory 
Number-number memory 
Figure recognition 
Sound grouping 
Vocabulary 


T 
T 
T 
gk 
T 
Bu 
T 
T 
z 
T 
ih 
T 
T 
iy 
Hf 
2 
T 
T 
T 


= 
ovu Wu aAa Au uu AN 


| 
=) 


*«*T?” designates tésts selected from those used by Thurstone, 


L2 Pronunciation 
(1) He has many things to do. He’s very buy. 
(2) He was promoted from a Captain to a Ma—or. 
(3) He wants to build a new bri——e over the river. 


(Here the subject indicates whether the letters in the blank 
spaces sound the same.) 


L3 Pronunciation II (Accent) 


DE-CLA-RA-TION The Declaration of Independence of the 
Fir? 3°34 United States was written by Thomas 
Jefferson. 


(Here the subject indicates which syllable receives the major 
stress.) 
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L4 Vocabulary (Colloquia!) 


It was an unusual expression and I couldn’t make out what it 
meant. 

(1) write 

(2) finish 

(3) believe 

(4) none of these 


Chinese tests. As an additional source of information on the degree of 
acquaintance with English, several tests in the Chinese language were 
included on the assumption that prolonged training in English would 
generally lead to some loss of familiarity with the Chinese characters, 
and that, therefore, the discrepancy between the Chinese and English test 
results would be related to the subjects’ familiarity with English. The 
Chinese tests, from among those used by the Nationalist Chinese Civil 
Service Examination Yuan, included 4 verbal multiple-analogy tests, Cl, 
C3, C6, and C8, each consisting of 25 items of the following type: 


(1) ... stern, mother... (1) teacher (a) mild 
(2) father (b) benevolent 
(3) family (c) tender 
(4) master (d) charitable 
(2) ... easy, knowing... (1) speaking (a) easy 
(a proverb by Wang Yung- (2) performing (b) profound 
ming) (3) doing (c) sincere 
(4) concerning (d) hard 
(3) ...«.. Support, self... (1) people (a) full 
(2) self (b) rich 
(3) allowance (c) sufficient 


(4) supplement (d) hold 


FIGURE 1 shows the questions as they appeared in the actual test. 
Since only 1 of the 16 possible combinations formed a Chinese proverb or 
idiomatic expression, it seems possible that this test combines features 
of a vocabulary test and a “‘proverb’’-type test of reading comprehension, 
while the complexity of the choices may leave room for the operation of 
some reasoning component. 

In addition, the Chinese tests included 4 multiple-choice number-series 
tests (C2, C4, C7, and C9) with questions of the following kind: 


C2 Number Series 
(1) 3 61; 9 12 15 
(2) 192 96 48 24 12 6 3 
(3) 4 o TGS “2300, 36s Oe nt 
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ae x tt bh] A 


MH BOR Ray RE QRwWSE PRE 

1 RAR (1) (3) (5) (6)H (a) Fe (b)H (c)M (e)M 3c 

2 Hse (2)H (4) He (7) 4F (8) (LDH (kK) (0) sR (P)FR _T_ 

2 ae (BA (9) 6 (7) (6)a0 (a) $e (c)# (bX (gl _9b- 
FIGURE l., 


Other Chinese tests included 1 digit-symbol substitution test (C5), an 
example of which is given in r1GuURE 2a; 1 test (C10) of the ‘‘matrices”’ 
type (FIGURE 2b); and 1 ‘‘symbol-ordering’’ (C11) test in which each 
item presents 5 drawings of symbols that form a progression when the 
positions of 2 of the 5 symbols are interchanged correctly (FIGURE 2c). 

The last 3 tests are Chinese adaptations from tests published by the 
British National Institute of Industrial Psychology. 

All the tests were lithoprinted and stapled to form six booklets. To 
avoid confusion and consequent copying errors, separate answer sheets 
were not used (except for the English Language Institute tests), the an- 
swers being marked directly on the test papers. 


Selection of Subjects 


After it was decided to use Chinese students as subjects, volunteers 


r----- 


on Pattoo 


c 


FIGURE 2. 
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were obtained by writing to all the Chinese students attending 7 
United States universities. The schools and the number of volunteers 
from each are as follows: University of Michigan, Ann Arbor, Mich., 30; 
University of Illinois, Urbana, Ill., 31; University of Detroit, Detroit, 
Mich., 2; Michigan State University, East Lansing, Mich., 7; Wayne Uni- 
versity, Detroit, Mich., 4; University of Chicago, Chicago, IIl., 16; and 
Northwestern University, Evanston, Ill., 2. 

There were 36 females and 56 males, and the mean age of the subjects 
was 26.4 years, with a standard deviation of 6 years. Thurstone’s sub- 
jects had a mean age of approximately 19.6 years, with a standard devia- 
tion of at least 2.6 years. 

As partial compensation for their time the subjects were paid 5 dollars 
and were given a report of their performance on the tests. They spent a 
total of 6 hours, usually in three 2-hour sessions. Whenever possible, 
volunteers came to group-testing sessions already scheduled for other 
individuals, so that the majority of the tests were administered to groups 
of 4 to 10 individuals. Cooperation was excellent and motivation high, so 
that the test results may be regarded as representative of the subjects’ 
best efforts. Although no proctors were used, test materials were easily 
distributed and the need for verbal explanations in addition to the printed 
test instructions was minimal. With volunteer subjects of this type, 
proctoring for dishonesty is unnecessary. Data are presented below on 
the degree to which the subjects were acculturated to the United States 
and on the influence of this on their performance in the various tests. 

The testing sessions were held in rooms that, without exception, pro- 
vided optimal conditions for the taking of psychological tests, being well 
lighted, quiet, and conveniently located. All the testing sessions were 
held between February and May, 1954. 


Statistical Techniques 


Tetrachoric correlations. Since Thurstone’s factor analysis was based 
on tetrachoric correlations, it was decided to use the same technique. 
Distributions for the tests were dichotomized near the median, resulting, 
in most cases, in a division very close to a 50-50 per cent split. A com- 
parison with the distributions in Thurstone’s study is given in TABLE 1. 

An edge-marking card was or was not notched, depending on whether an 
individual’s score was above or below the cutting point. After preparation 
of the 92 cards, 1 for each subject tested, 2 x 2 tables were made in the 
following way. After all the cards not notched for Variable 1 were lifted 
from the deck with the sorting needle, the resulting 2 piles were weighed. 
The 2 weights thus obtained were converted to percentages by consulting 
a previously prepared conversion table. It had been determined before- 
hand that the loss of weight of a card through repeated notchings of the 
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edge did not result in more than 0.4 per cent error. After the marginal 
dichotomous distributions had thus been checked, the section of the deck 
“‘passing”’ on Variable 1 was sorted again on Variables 2, 3, 4, and those 
following, each sort being followed by a weighing of the 2 ensuing piles 
and by an entry of the proper percentages into the body of the 2 x2 tables. 

Values for the tetrachoric correlations were then estimated by interpo- 
lation from the Chesire, Saffir, and Thurstone tables. 54 

Multiple-group factor analysis. The resultant matrix of intercorrela- 
tions was factor-analyzed by the multiple-group method. Columns and 
tows were interchanged until the higher correlations seemed to be grouped 
around the diagonal. Communalities were then estimated for the tests in 
each little group by substituting the values of the projections of the test 

onto the centroid axis for the subgroup (see Thurstone !8), 

After most of the tests had been grouped satisfactorily, two tests re- 
mained that reportedly measured perceptual speed. To define the centroid 
axis better for this test doublet, the spatial-visualization test that corre- 
lated most highly with the perceptual-speed tests was added, on the 
assumption that perceptual speed enters appreciably into the score on 
spatial-visualization tests. Test T18 (‘‘Cubes’’) was thus used in two 
communality calculations; of the two values of its communality thus cal- 
culated, the higher was inserted in the diagonal. 

Application of the multiple-group method led to 7 factors. This set 
of oblique factors was orthogonalized according to Thurstone’s technique, 
with one difference: rather than putting the first centroid axis through the 
factor having the most variance, the factor least clearly defined was 
chosen. Since later steps in the computations would involve calculation 

‘of ‘principal component axes, it seemed advisable to favor this less 
clearly defined factor in view of the rigors of the rotations to follow. 
After the 7 orthogonal factors were obtained, the sums of the factor 
products were calculated and subtracted from the original correlations. 

The residuals were tabulated and inspected for size (lower left portion of 
TABLE 3). Since appreciable values were left, the centroid method of 
factoring was next applied and 7 more factors extracted. The distribution 
of the thirteenth factor residuals indicates that factoring had gone suffi- 
ciently far by this time (TABLE 2). In each case the sign-changing 
- (‘‘reflecting’’) of rows and columns was continued until the column sums 
were zero or positive rather than stopped when a column had a majority 
of positive signs. 

After 44 rotations, simple structure was achieved for the first 8 factare, 
while 8 more rotations seemed to define 5 of the remaining 6 clearly as 
residual. No attempt was made to clarify the last factor, which was used 
only as a pivot for rotating several previous factors. 

Rotation to maximal congruence. The final step consisted in the rota- 
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TABLE 3 


Ix 
RESIDUALS AFTER SUBTRACTION OF FF 


*Seven factors in multiple-group method, 


tion of the factors found in the Chinese data into maximal congruence 
with the factors found by Thurstone,‘*> according to Tucker’s method. 9” 

For an intuitive understanding of Tucker’s method, it may be best to 
visualize two identical sets of data, plotted in two different sets of 
coordinate systems. Rather than rotate one set of coordinates into the 
other system, Tucker rotates each set of coordinates half way, to the 
point where they meet, and determines the agreement. If one set were 
rotated completely into the position defined by the other, its simple 
structure might be lost entirely. 

To rotate set T into C in completely error-free data, we could find the 
transformation matrix T7¢ from the location of one common point in each 
of the two coordinate systems. However, if the location of such a common 
point is not quite free of error, it is better to base our calculations for 
Trc on all the common points. 

In the present case, points common to the two sets of coordinates are 
the tests common to the two studies. The scores on these tests do in- 
clude errors of measurement and factors specific to each test and each 
group of subjects. The method therefore calculates the transforma- 
tions that will carry the matrix that shows the relations between tests 
and factors in study T into the position defined by- factor matrix C by 
calculating the correlations over allthe common tests between the factors 
in T and the factors in C, After being normalized, this matrix would form 
the transformation matrix Ty ¢ and, if the matrix were square, its trans- 
position would be, when normalized, the transformation matrix Toy. 

However, we have neglected the fact that the original factor matrices 
may not be orthogonal, When we remember that, in addition, in both cases 
the calculations will be based only on the common tests and not on the 
complete set used in the factor analyses (so that the rows for all tests 
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but the common ones are removed), it will be clear that this reduced 
factor matrix in general will not be orthogonal. The first step is therefore 
to orthogonalize the matrices. This is done in Tucker’s method by the 
ptincipal-components solution with unity in the diagonals, since at this 
point we are working with the covariances of the factors and not those of 
the individual tests. Thereafter, we proceed as outlined above until we 
reach the matrix of the relations between the factors in T and the factors 
in C. Unless the factors are the same and in the same order, this matrix 
will not be symmetrical and, therefore, the square of this matrix will not 
be orthogonal. Furthermore, if we calculate the correlations between 
factors in T in terms of the correlation of each of these factors with the 
factors in C, the resulting factor matrix will not be the identity matrix. 
Hence, we must orthogonalize this matrix, too, before normalizing it into 
a transformation matrix T7¢. Similar considerations hold, of course, for 
Tcr. Since the essence of the method is to rotate each matrix halfway, 
we average the square root of the elements of the two resultant transfor- 
mation matrices by taking the square root of the sum of their squares, to 
get a least-squares fit. 
Summarizing in matrix notation: 


Form Egy F er 
Solve \Fur Fur —Al| =0 
This gives the roots A,, and the matrix of eigen vectors App - 


nn 


ia Pi = Appr , 


FyrTrp, = Py 


where T and C indicate Thurstone’s factors and the Chinese-factor matrix, 
respectively, for the twenty common tests M and m, and F is a matrix of 
oblique factor loadings, P is a matrix of principal component loadings, 
and T is a transformation matrix. 

Similarly, 


FncFmco gives App, andthe roots Aj, 
Treo = Arpo Ae” 


Fac Treo ee lite 
We then form 


Gro = PrPé 
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and then 
H = GG' 
Solve 
' |H-AI| = 0 


to obtain the roots \,, and the matrix of eigen vectors A,,. 
Form 


Ya 
¥ § eT Trp GAy An 
and 


49 


rc = Trp, Au 


where the subscript r indicates principal component factors. Then calculate 


W = ths 1/2 (Sry ore) 


where the 7s are the corresponding elements for each test on each factor. 
If we then form a diagonal matrix 


D = WI 
and obtain 
Tur = T atdl 
and 
Teme = "ie D 


the two factor matrices rotated to maximal congruence will be 
Fer = FurTrmr 
and 


Fro 7 Fic a 


from which we can calculate our indices of agreement. 


RESULTS 
Test Score Distributions 


TABLE 1 gives the means and standard deviations for the 92 Chinese 
students on the 20 tests taken from Thurstone’s study. For comparison, 
the means and standard deviations for Thurstone’s data have been in- 
cluded. The value at which the Chinese distributions were dichotomized 


is also included, while the medians for Thurstone’s distributions are 
again listed for comparison. 
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The table shows that the distributions were probably dichotomized at 
about the same values in both studies. The comparison indicates further 
that, while the means and sigmas for the two groups are rather similar, 
there were substantial differences in the distribution of scores on some 
of the tests. 

Because tetrachoric correlations were used in both studies, no attempt 
could be inadeto eliminate the effect of selection and restriction of range 
in Comparing the two groups. 


Results of Factor Analysis 


TABLE 2 presents (above the diagonal) the tetrachoric correlations 
for the Chinese data and (below the diagonal) the residuals, after extrac- 
tion of the first 7 factors by the multiple-group method. In the diagonal are 
shown the communalities used, calculated from the projections on the 
centroid of the tests grouped (See Thurstone**®).TABLE 3 gives the resid- 
uals after extraction of 7 factors, and TABLE 4 after extraction of 13 
factors. 

TABLE 5 gives the centroid-factor matrix; TABLE 6, the rotated factor 
matrix; TABLE 7, the correlations between the rotated factors; and 
TABLE 8, the transformation matrix. 


TABLE 4 


RESIDUALS AFTER THIRTEEN FACTORS 


Interpretation of the Factors in the Chinese Data Before Rotation 
to Maximal Congruence with Thurstone’s F actors 


Factor 1 is defined by the following saturation coefficients: 


86 Chinese vocabulary test, Part I 

82 Chinese vocabulary test, Part IV 
76 Chinese vocabulary test, Part III 
71 Chinese vocabulary test, Part II 
42 Chinese number series test, Part 2 
36 PMA* 21, form board 


*Primary Mental Abilities Test. 
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TABLE 5 


CENTROID FACTORS 


asec aha xu 


-06 
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TABLE 6 


ROTATED FACTORS 


SERPENT 'T [8 [3 ho [a fe 


282 Annals New York Academy of Sciences 


TABLE 7 


CosINES OF ANGLES BETWEEN OBLIQUE F ACTORS 
ge 
1 2 §- ho SF \6 ee Se eer eee 


1.00 04 -06 03 O02 -01 -18 -01 -06 06 02 -07 -03 
1.00 -O4 O4 -13 -16 -02 -05 -05 01 -02 -05 -05 
1.00 -04 -14 18 09 -01 -02 -06 -16 -09 -18 
1.00 -27 O04 o2 -09 02 09 24 14 27 

99 -13 -ll1 00 -12 00 -06 -06 -08 

1.00 -04 -02 -05 07 15 O7 15 

1.00 19 12 25 18 -16 0o4 

99 16 -0O4 -03 03 00 

1.00 -26 -18 19 -01 

2.00 22 b a cele 

1.007 O17 72 

1.00 -13 

1.00 


TABLE 8 


TRANSFORMATION MATRIX A 
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This factor will be called Chinese proverbs. Its exact nature cannot be 
stated. In the section describing the tests, the opinion was ventured that 
the Chinese vocabulary tests might measure reading comprehension and 
reasoning in addition to the knowledge of the proverbs. 

There seems to be little to support the idea that these tests measure 
reasoning, Since they have nearly zero loadings on all the other factors. 

Factor 2 is very clearly defined as follows: 


82 PMA 58, vocabulary 

68 PMA 41, verbal analogies 

67 PMA 11, completion 

67 PMA 6, verbal classification 

66 Lado test of English, Part IV: vocabulary 

63 Lado test of English, Part I: structural meaning 
62 PMA'55, sound grouping 

62 PMA 5, reading 

58 Lado test of English, Part II: sound grouping 
53 Lado test of English, Part III: accent 

39 PMA 40, reasoning 

32 Chinese number series, Part 1 

27 PMA 43, code words 


This is the verbal factor, which has been among the first and best 
established factors. It may seem surprising to find this factor emerging 
so clearly, until it is realized that this is due to the abundance, in this 
study, of tests measuring this factor, and to the unusually wide spread of 
the distributions of scores on these tests in this group of subjects. 

Factor 3 lias these factor saturations: 


72 PMA 48, number-number memory 
41 PMA 50, figure recognition 

30 PMA 46, word-number memory 

30 Chinese test, reordering symbols 
29 PMA 24, punched holes 

28 PMA 43, code words 


This appears to be a memory factor. During the administration of the 
tests, there was some indication that the memory tests might also be 
regarded as measures of motivation, since the more eager subjects 
seemed to perform better on those tests. The same effect would probably 
prevail for United States students. 

Factor 4 is defined by saturations on these tests: 


73. PMA 21, form board 
68 PMA 24, punched holes 
67 PMA 39, arithmetic reasoning 
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65 PMA 18, cubes 

62 PMA 20, flags 

60 Chinese number series, Part 3 
48 Chinese number series, Part 1 
46 Chinese test, reordering symbols 
46 PMA 11, completion 

37 Chinese test, matrices 

31 PMA 33, multiplication 


This appears to be a mixture of a spatial visualization factor and a 
reasoning factor. 
Factor 5 has the following factor saturations: 


65 PMA 26, identical forms 

58 Chinese test, symbol coding 

47 PMAS55, sound grouping 

38 PMA 43, code words 

31 PMA 18, cubes 

29 Lado test of English, Part I, structural 
meaning 

28 Chinese test, matrices 


This appears to be the perceptual speed factor. 
Factor 6 is defined as follows: 


79 PMA 31, addition 

63 PMA 30, number code 

59 Chinese number series, Part 4 
52 PMA 33, multiplication 

45 Chinese number series, Part 2 
42 PMA 39, arithmetic reasoning 
30 Chinese number series, Part 1 
14 Chinese number series, Part 3 


This factor is the number factor, concerned with the ability to perform 
elementary arithmetic operations. 
Factor 7 has the following definition: 


51 Chinese test, reordering symbols 
44 PMA 40, reasoning 

42 Chinese test, matrices 

41 Chinese number series, Part 4 
35 PMA 46, word-number memory 

28 Chinese number series, Part 1 
26 PMA 11, completion 
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This factor appears somewhat to resemble the reasoning factor, as well 
as the deduction factor in Thurstone’s study. 

No attempt was made to interpret the following two factors, defined as 
follows: 


Factor 8: 
46 Chinese number series, Part 2 
44 Chinese number series, Part 1 
27 Lado test of English, Part I, structural 
meaning 
25 Lado test of English, Part III, accent 
Factor 9: 


66 Lado test of English, Part III, accent 
45 Chinese number series, Part 2 

29 PMA 48, number-number memory 

27 Chinese test, reordering symbols 

25 PMA 55, sound grouping 


Agreement of Factors, as Such, with Thurstone’s Factors 


Some indications of the agreement between these factors and Thur- 
stone’s can be had by inspection of TABLE 9, which shows the product- 
moment correlations between the factors in the Chinese study and in 
Thurstone’s study before the rotation to maximal congruence. These are 
what Burt calls ‘‘adjusted’’ correlations between factors.** 

TABLE 10 gives ©®,, which is identical with what Burt calls 
justed’’ correlations: 


‘“unad- 


D ai; Fix 
Vf CS Ba) 


where a;; is the loading of test 1 on factor j, and the summation is over 1. 


®, = 


Significance of Factors 


In the absence of a commonly agreed upon exact test of the significance 
of the k" factor extracted in a factor analysis, it is a widespread prac- 
tice to err on the side of extracting too many rather than too few factors. 
The argument is that nonsignificant factors will not lead to simple struc- 
ture and be treated as residual error factors. 

All 13 factors from Thurstone’s study were compared with 13 factors 
from the Chinese data. These undoubtedly included a number of factors 
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TABLE 9 


PRODUCT-MOMENT CORRELATIONS BETWEEN OBLIQUE F ACTORS IN THE CHINESE DATA 
AND FACTORS-IN THURSTONE’S STUDY (FOR 20 COMMON TESTS) 


Thurstone’s factors 


Chinese factors 


TABLE 10 


©, BETWEEN CHINESE AND THURSTONE’S DATA 
BEFORE ROTATION TO MAXIMAL CONGRUENCE 


Thurstone’s factors 


g 
3 
o 
3 
§ 
5 


Vandenberg: Primary Mental Abilities of Chinese Students 287 


of questionable significance. Next, the significance of each principal 
axis factor was approximated, Although not strictly applicable, two 
different criteria were used. 

Bartlett®® has proposed as a criterion the homogeneity of the remaining 
roots after extraction of K roots by a component of x? based on the dis- 
tribution ratio of the product of the remaining roots to the arithmetical 
average of the remaining roots raised to a power equal to their number: 


i 2 
2 
xX = -tn- | (2p +5)- = k} log, Rp. 
where 
p-k 
|R| p-k 
p-k 30 ia a ee a ape Saar ee 
AyAQ +o Ay DApH— Ay HAQ ss Ag 


with degrees of freedom equal to 
1 
GZ e-* (p — k — 1) 


Rao has proposed a similar test.°’ As a check, a second approximation 
was used, Anderson *® has proposed the following criterion: 


1 
—— (A, —k-n) 


Yn 
which is distributed nearly normally with zero mean and variance 2 k for 


large n; otherwise 
ey 2 
—— (A, -—k-n)-\Vnp 
Vn 
is asymptotically normally distributed with zero mean and variance 


2k + Ap? 
where 


P 
Ax = (n-1) > Ai 


and where p is the smallest nonzero root and p is the last root. 
Both these tests are approximate for correlation matrixes, assuming 
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uncorrelated normally distributed error variances and unit entries in the 
diagonal cells. 

In this application we do not have a correlation matrix based on 
the original measures, but rather a squared matrix of loadings of n tests 
on p oblique factors, so that these criteria can be used only as approxi- 
mations or ‘‘educated guesses.’’ 

TABLES 11 and 13 give the results for Bartlett’s test and TaBLEs 12 
and 14, those for Anderson’s test. 


TABLE ll 


THURSTONE’S DATA 


BARTLETT’S TEST FOR HOMOGENEITY 
OF VARIANCE AFTER REMOVAL 
OF k FACTORS 


ONMWT FUNH 


The Rotation to Maximal Congruence (13 x 13 Factors) 


The transformation matrix carrying Thurstone’s 13 factors into the 12 
principal axes maximally congruent with the Chinese data is shown in 
TABLE 15, and the transformation matrix for the Chinese factors is 
shown in TABLE 16, 

TABLE 17 shows the agreement in terms of ®, between 12 factors from 
the Chinese data and 12 factors based on Thurstone’s data, while TABLE 


18 shows the Chinese factors, and TABLE 19 shows Thurstone’s factors 
after this rotation. 
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TABLE 12 


ANDERSON'S TEST 


ON OW FUME 
FEE EF FUN MONDE 


TABLE 13 


CHINESE DATA 


Bartlett’s Test for Homogeneity of Variance 
after Removal of k Factors 


ONO FUN H 
WNW ANYWD Qouw 


290 Annals New York Academy of Sciences 


TABLE 14 


ANDERSON’S TEST 


30.49 
23.72 
29.32 
26313 


FUN H 


On Ont 


Interpretation of the Factors from the Chinese Data (after Rotation to 
Maximal Congruence with Factors from Thurstone’s Study) 


Since Tucker’s method uses the principal-axes method, the congruent 
factors do not exhibit simple structure and will have to be rotated in the 
common space to be readily interpreted. 

Fortunately, it became possible to obtain a quartimax solution®® on the 
ILLIAC. This method gives the orthogonal transformation that maximizes 
the variance of the factor loadings (that is, it maximizes the sum of the 
squared-factor variances). In doing so, the method will of course result in 
an increase in the number of zero or near-zero loadings, as well as in an 
increase in the size of the larger loadings. To that extent the method 
forms an approach to orthogonal simple structure. The method is mathe 
matically equivalent to the one proposed by Carroll,®°! which minimized 
the cross products of squared loadings. However, Carroll’s method allows 
for an oblique solution, while the quartimax method does not. 

TABLE 20 shows the congruent factors from Thurstone’s data after 
rotation by the quartimax method, while raBLeE 21 shows the Chinese 
factors after the same rotation. 

The first 5 congruent factors are defined in TaBLE 22. The remaining 
7 congruent factors are not clearly defined. None of them has more than a 
Single test saturation greater than .50. 
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TABLE 15 


TRANSFORMATION MATRIX T,; Tp 


a UWDH ZZ BS S42 WY 


TABLE 16 


TRANSFORMATION MATRIX T; cp 


Annals New York Academy of Sciences 


292 


One? 
L230 
9590 
0020 
Sret 
SSt0 
06<0- 
Lrgz2 
Szlr- 
66ST 
Grgo- 
€S90- 


Tar ae [x for 


LEgo | gOTO- 
0000 | 6T00 


6190 | #000 


$10]0B] S,auojsiny J, 


AONANADNOD IVWIXVW OL NOILVLOY YaLay VLVG ASANIHO WOU Y ANY 
VLVQ S:ANOLSUNH] WONA SLNANOdWOD IvdIONIAg AATAML NAIMLAG 76 


LI AIaVL 


SJojOBy] eseulysD 
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TABLE 18 


TWELVE FACTORS FROM CHINESE DATA AFTER 
ROTATION TO MAXIMAL CONGRUENCE 


é:| «+| +] 9°| of an 


7! 
-10 


Relation of the Factors with Some Tentative Measures of Acculturation 


In addition to results of the thirty-five tests, thirteen dichotomous vari- 
ables were derived from the subjects’ answers to the following questions: 

(a) Do you room with other Chinese students? 

(b) Were you more than 11 years old when first taught English? 

(c) Have you been in the United States more than 55 months? 

(d) Are you more than 24 years old? 

(e) What is your sex? 
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TABLE 19 


TWELVE FACTORS FROM THURSTONE’S DATA AFTER 
ROTATION TO MAXIMAL CONGRUENCE 


(f) Are you married to a Chinese? 

(g) Is your proficiency in English high or low? 

(h) Do you consider the time limits for the psychological tests too 
short? 


(i) Do you see many or few English and American movies? 

(j) How many books have you read in English? 

(k) Is your reading in English newspapers and magazines extensive? 
(1) Do you speak Chinese outside of classes? 

(m) Do you feel handicapped in taking tests in English? 

(n) Do you feel handicapped in class? 


TABLE 23 shows the tetrachoric correlations i : 
: aby of these variabl itt 
the first 7 oblique factors, iables with 
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TABLE 20 


THE CONGRUENT F ACTORS FROM THE CHINESE 
DATA AFTER QUARTIMAX ROTATION 


Thurstone’s factors 


| [| siviwlule|e 7 [2 [o fro far fro 
-08!} 88/-10 -O4 -08] 01-02] -02| - 


19 03 
-08 04 
06 01 
20 02 
-02 -05 
-06 06 
‘ -02 07 
8 38 13 
s 84 -04 
3 46 O4 
Ss) 14 09 
-12 05 
18 16 
-08 -04 
08 -01 
07 07 
20 04 
-05 12 
O4 06 


Correlations with only 7 factors are shown because these measures, in 
order to avoid loss of definition of the factors, were not included with the 
original factor analysis. Instead, the correlations of these measures with 
all the 35 tests were carried in the margin of the computation shects for 
the multiple-group method, and correlations with factors were obtained by 
an extension of the final multiple-group transformation matrix to those 
correlations. It did not seem worth the computational labor to determine 
the relation of the acculturation measures to additional factors. 

If we take a p-value of .01 as our criterion of significance, we find that 
the only correlations between the questionnaire items and the oblique 
factors that reach this level of significance are: 
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TABLE 21 


THE CONGRUENT FACTORS FOR THURSTONE’S 


DATA AFTER QUARTIMAX ROTATION 


§ 
8 
E 
g 
5 


Factor V 
Factor V 
Factor V 
Factor S 
Factor S 
Factor P 


and 
and 
and 
and 
and 
and 


aK-ogare 


(age at first English instruction) 
(amount of English newspaper reading) 


(feeling of handicap in taking tests) 


(sex of the subject) 
(speaking Chinese outside of classes) 
(age of subject) 


= 5 


That comprehension of verbal material in the English language corre- 
lates with the age at which the first instruction in English was received 
is not surprising. The younger one is when starting such instruction, the 
more experience with English one will have gained, in general, at the 
time of college entrance, Furthermore, earlier learning is known to be 
more effective in many instances. That comprehension of English is 
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TABLE 22 


DEFINITIONS OF THE FIRST FIVE CONGRUENT FACTORS 


Thurstone’s 
data 


Chinese 
data 


Factor S (spatial) ©, =.873 


PMA 24 #£2Punched holes 
PMA 20 Flags 

PMA 21 Form board 
PMA 18 Cubes 


Factor V (verbal) ©, =.910 


910 PMA 5 Reading 

778 PMA 11 Completion 

883 PMA 58 Vocabulary 

-650 PMA 41 Verbal analogies 
-617 PMA 6 _ Verbal classification 
514 PMA 55 _ Sound grouping 

585 PMA 40 Reasoning 


Code words 


Factor N (number) ®, =.855 


PMA 31 _ Addition 
PMA 33 Multiplication 
PMA 30 Number code 


Factor M (memory) ®, =.830 


PMA 48 Number-number memory 
PMA 46 Word-number memory 
PMA 50 _ Figure recognition 


PMA 26 Identical forms 
PMA 5 _ Sound grouping 
PMA 6 _ Verbal classification 


*This value in excess of unity is due to an overly high value for the communality 
inserted for the multiple-group analysis. The resulting high negative residuals led to the 
extraction of further variance for this factor, Its h2 also exceeds unity, 
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TABLE 23 


CORRELATIONS OF THE OBLIQUE FACTORS AND 
ITEMS FROM THE QUESTIONNAIRE* 


*The standard deviation of tetrachoric r runs froin ,1638 for a 50-50 split to 
.1669 for a split at 41-59 in both variables,°? The split always fell within this range. 


related to the amount of English newspaper and magazine reading may 
have two causes, Students who performed well in English in school may 
read English material more readily for pleasure and information, while 
such additional reading would reinforce the formal instruction received 
in school. 

The third correlation is a little less obvious. That the Chinese students 
who felt handicapped in taking tests in English tended to perform better 
on tests of verbal comprehension in English seems to indicate that a 
certain level of proficiency in English is necessary before one begins to 
be aware of one’s shortcomings in the language. 

No other factor showed an appreciable correlation with any of the items 
primarily concermed with the subject’s experience with the English 
language. The correlation between Factor S and whether the subject 
reportedly spoke chiefly Chinese outside of classes may be due to the 
fact that the subjects in this study included several cliques of engineer- 
ing students who roomed together. These students did speak mostly 
Chinese among themselves and seemed to perform above the average on 
the spatial-visualization tests. 

The two other significant correlations indicate that there is a negative 
correlation between perceptual speed and age, which is in agreement with 
the findings in many studies that a decrease in speed occurs with in- 
creasing age. That males tend to perform better than females on spatial- 
visualization tests is a conclusion that is also in accord with the find- 
ings of other studies. 
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INTERPRETATION OF THE RESULTS 
Significance of the Values of ®, 


There is no statistical test of the significance of D,, and it will be 
a difficult matter to determine the correct number of degrees of freedom 
for such a test. 

There are few data available that can be compared with the results 
obtained in this study. While the ®,s obtained here fall short of the very 
high values reported by Tucker in his Army Personnel Research Section 
report*” or those reported by Wrigley and Dickman, !9 the values of ®, for 
the factors V, S, N, M, and P obtained in this study seem sufficiently high 
to give support to the claim that these factors remain invariant under 
widely varying conditions. To place the values obtained in this study in 
their true perspective, it will be necessary to compare them with values 
’ to be obtained in further studies using Tucker’s method. 


Ahmavaaro’s Transformation Analysis 


In view of the scarcity of comparable results, Ahmavaaro’s data‘** 
acquire added importance. Although his ‘‘transformation-analysis’’ tech- 
nique is not quite identical with that employed by us, it yields what he 
terms an ‘‘invariance coefficient.’? These coefficients are the diagonal 
elements of L =(X'X)1X'Y, after the factor matrix X (found in Study X) 
and the factor matrix Y (found in Study Y) have been made orthogonal, 
and after rows of L have been normalized. 

However, when X is an orthogonal solution, the product X‘X will be a 
diagonal matrix D~'J, where the elements of D are > (x;,)? and where the 
x,; ate the loadings of test i on factor ie In the case of an orthogonal 
solution in study X, the matrix L = (X'X)"1 X'Y =D"! IX'Y can therefore 
be written as a matrix with elements 


x Xij Vik 


Ahmavaaro then normalizes yy rows of this matrix. This can pds written 
as a postmultiplication by D; "L, where the elements of D, are Ss if ae 
On the other hand, Tucker’s tadex 


2 Xij Vix 
lef ints 
Xij Vir 


forms an element of a matrix similar to L, which may be written 


®, = 
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(D, 1)’ X'¥ (D,D* 


where D, and D, are a. row vector and a column vector with elements 
Vx; and yy;,.This matrix will be identical with Ahmavaaro’s L after 
the latter is postmultiplied by some diagonal matrix, the elements of 
which will be closer to unity the closer the agreement between corre- 
sponding factors in the 2 studies. 

Ahmavaaro applied his technique twice: first, to the results of the 60- 
test and 21-test study of 14-year-old children reported by Thurstone. 7% 
Ahmavaaro reports the following values for the diagonal elements of L 
(after the factors in both studies had been made orthogonal): 


Wi er R_ .848 
5 + 3968 N .744 
VW) > 967 Pp '.669 
M_ .929 


Next he applied his transformation analysis to the results of Thur- 
stone’s 57-test PMA study*® and the results of the 27-test study of the 
perceptual factor.’© For both these studies the subjects were college 
students and the factors were orthogonal. Ahmavaaro reports values as 
follows. 


N~ .891 W  .617 
S .782 Ll. .s609 
M_ .774 Ve aan 
P ..698 


Unless the difference between his and Tucker’s techniques results in 
marked differences in the values of the respective invariance coefficients, 
the results of the Chinese students-United States students comparison 
shows an agreement between factors that is as close as or even closer 


than the agreement between factors found for two groups of United States 
students, 


Meaning of the Agreement Found 


It was reported above that, of the first seven oblique factors found 
in the Chinese data, the verbal factor was significantly related to 
several of the acculturation measures. This seems to warrant the conclu- 
Sion that factors such as are found in factor-analytic studies are due, at 
least partly, to cultural and educational influences. Since it is difficult 
to see how abilities even strongly controlled by hereditary factors could 
be acquired without such influences, this may seem a truism. On the 
other hand, the high values of ®, for such factors as N, and particularly 
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S, in spite of great differences in the linguistic background of the sub- 
jects in the two studies, seem to indicate that there may be at least 
several independent abilities that are to some extent independent of the 
various kinds of educational experiences undergone, provided that some 
kind of training has occurred. 

While it is still possible that there is enough Similarity between the 
educational and other cultural influences undergone by the Chinese 
students and those undergone by the United States students to lead to a 
highly similar set of independent abilities, it seems more plausible to 
assume that, at least for the factors S, N, V, P, and M, there exist poten- 
tialities in the human neurophysiological organization that are independ- 
ent of one another and that limit the performance on certain types of 
tasks, rezardless of the kind of educational experiences undergone, and 
. provided there have been enough such experiences to develop these 
potentialities. A comparison of two groups, one with considerable train- 
ing in geometry, the other without such training, might give added evi- 
dence for such an hypothesis. 


Discussion and Suggestions for Further Research 


It was mentioned above that the more dissimilar the two groups to 
which the tests were administered, the less agreement one might expect 
between factors in the two studies and, conversely, the more agreement 
found, the stronger would be the argument for the psychological reality of 
well-defined factors. 

In addition, it should be pointed out that the fewer the problems that 
can be solved by more than one type of approach in a particular set of 
tests defining a factor, the greater the agreement that can be expected 
between factors in different studies. Thus, it seems unlikely that the 
tests defining the verbal factor allow for more than one kind of approach. 
While the tasks in the tests defining the spatial factor may allow for 
for some kind of verbal reasoning approach, recognition and verbalizing 
of spatial relations would precede any such verbal reasoning and would, 
therefore, still limit the performance on such tests. 

On the other hand, there may be tasks represented in other tests that 
leave room for the operation of one of several types of problem-solving. 
In such a case the agreement between factors found in several studies 
could be lower. 

It would be interesting to approach this problem by determining whether 
a set of tests, each of which has a high homogeneity °° or which forms a 
more nearly perfect scale,°? would lead to a higher ®, value than would 
a less homogeneous set of tests. 
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SUMMARY AND CONCLUSIONS 


After the scores on 35 tests for 92 students from China studying at 
United States universities were factor-analyzed, simple structure was 
obtained for a slightly oblique set of 13 factors. 

Of the 35 tests employed, 20 were identical to tests employed by 
Thurstone in his PMA study of United States college students. 

The 20 tests common to both studies were rotated into maximal con- 
gruence according to Tucker’s procedure, and the 12 congruent factors 
were rotated into an approximation to simple structure by the quartimax 
method. 

Five congruent factors could be readily identified as the spatial, 
verbal, numerical, memory, and perceptual speed factors. The values of 
the index of agreement ®, for congruent factors were S, .87; V, .91; NW, .86; 
M,.83; and P, .73. These values compare favorably with those found in sev- 
eral comparisons of factors in studies using United States subjects only. 

The only nonspurious correlations (of appreciable size) of the original 
oblique factors for the Chinese data and of ites from the acculturation 
measures were those for the verbal factor. It is concluded from this that 
cultural influences play a role in the process leading to the formation of 
the abilities underlying some of the factors, but that at least several 
potentialities exist in the adult human neurophysiological organization 
that are independent of one another and, to some extent, independent of 
the particular kind of cultural, linguistic, and educational background of 
the subjects tested. 
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